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Abstract: We provide a new algorithm for the treatment of inverse prob- 
lems which combines the traditional SVD inversion with an appropriate 
thresholding technique in a well chosen new basis. Our goal is to devise 
an inversion procedure which has the advantages of localization and mul- 
tiscale analysis of wavelet representations without losing the stability and 
computability of the SVD decompositions. To this end we utilize the con- 
struction of localized frames (termed "needlets") built upon the SVD bases. 

We consider two different situations: the "wavelet" scenario, where the 
needlets are assumed to behave similarly to true wavelets, and the "Jacobi- 
type" scenario, where we assume that the properties of the frame truly 
depend on the SVD basis at hand (hence on the operator). To illustrate 
each situation, we apply the estimation algorithm respectively to the de- 
convolution problem and to the Wicksell problem. In the latter case, where 
the SVD basis is a Jacobi polynomial basis, we show that our scheme is 
capable of achieving rates of convergence which are optimal in the L2 case, 
we obtain interesting rates of convergence for other Lp norms which are 
new (to the best of our knowledge) in the literature, and we also give a 
simulation study showing that the NEED-D estimator outperforms other 
standard algorithms in almost all situations. 
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1. Introduction 



We consider the problem of recovering a function / from a blurred (by a linear 
operator) and noisy version of /: = Kf + eW. It is important to note that, 
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in general, for a problem like this there exists a basis which is fully adapted 
to the problem, and as a consequence, the inversion remains stable; this is the 
Singular Value Decomposition (SVD) basis. The SVD basis, however, might be 
difficult to determine and handle numerically. Also, it might not be appropriate 
for accurate description of the solution with a small number of parameters. 
Furthermore, in many practical situations, the signal exhibits inhomogeneous 
regularity, and its local features are particularly interesting to recover. In such 
cases, other bases or frames (in particular, localized wavelet type bases) might 
be much more appropriate to represent the object at hand. 

Our goal is to devise an inversion procedure which has the advantages of 
localization and multiscale analysis of wavelet representations without losing 
the stability and computability of the SVD decompositions. To this end we 
utilize the construction (due to Petrushev and his co-authors) of localized frames 
(termed "necdlcts") built upon particular bases - here the SVD bases. This 
construction uses a Calderon type decomposition combined with an appropriate 
quadrature (cubature) formula. It has the big advantage of producing frames 
which arc close to wavelet bases in terms of dyadic properties and localization, 
but because of their compatibility with the SVD bases provide stable and easily 
computable schemes. 

NEED-D is an algorithm combining the traditional SVD inversion with an 
appropriate thresholding technique in a well chosen new basis. It enables one to 
approximate the targeted functions with excellent rates of convergence for any 
Lp loss function, and over a wide range of Besov spaces. 

Our main idea is by combining the thresholding algorithm with SVD-based 
frames to create an effective and practically feasible algorithm for solving the 
inverse problem described above. The properties of the localized frame to be 
constructed depend on the underlying SVD basis. We will consider two different 
behaviors, the first corresponds to a "wavelet" behavior in the sense that the 
properties of the system arc equivalent (as far as we are concerned) to the 
properties of a true wavelet basis. This case typically arises in the deconvolution 
setting. In the second case, the properties of the frame may differ from wavelet 
bases and truly depend on the SVD basis at hand (hence on the operator K). 
We will explore in detail a case typically arising when the SVD basis is a Jacobi 
polynomial basis. It is illustrated by the Wicksell problem. We show that our 
scheme is capable of achieving rates of convergence which are optimal in the L2 
case (to the best of our knowledge, for the Wicksell problem this is the only 
case studied up to now). For other Lp norms we obtain interesting rates of 
convergence, which are new in the literature. 

We also give a simulation study for the Wicksell problem which shows that the 
NEED-D algorithm applied in combination with SVD based frames is valuable 
since it outperforms other standard algorithms in almost all situations. 

The paper is organized in the following way: the second section introduces 
the model, the classical SVD methods, and the two basic examples considered 
in this paper, i.e. the deconvolution and Wicksell problems. The third section 
introduces the needlet construction, gives some basic properties of needlets and 
introduces the NEED-D algorithm. The fourth section explores its properties in 
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the wavelet scenario. The main motivation for the NEED-D algorithm is given 
there after. The fifth section is devoted to the results in a Jacobi scenario. The 
sixth section is devoted to simulation results. The proofs of the main results 
from sections |4]-[5] are given in sections [THU respectively. The last section is 
an appendix which contains the definition and basic properties of the Jacobi 
needlets and the associated Besov spaces. 

2. Inverse Models 

Suppose H and K are two Hilbert spaces and let iiT : H K be a linear 
operator. The standard linear ill-posed inverse problem consists in recovering a 
good approximation of the solution / of 

g^Kf (1) 

when only a perturbation 1^ of g is observed. In this paper, we will consider the 
case when this perturbation is an additive stochastic white noise. Namely, we 
observe defined by the following identity: 

Y,^Kf + eW, (2) 

where e is the amplitude of the noise. It is supposed to be a small parameter 
which tends to 0. The error will be measured in terms of this small parameter. 
Here IF is a K-white noise, i.e. for any g,h G K, ^(g) := {W,g)]K, £,{h) := 
{W, /i)k form random Gaussian vectors (centered) with marginal variance WgW^, 
and covariance (g, /i)k (with the obvious extension when one considers k 
functions instead of 2). 

Equation ^ means that for any g E K, we observe Ydg) := {Y^,g)K = 
{Kf,g)K + £^{9), where £,{g) ^ N{0, WgW^), and Y^{g), Y^(h) arc independent 
random variables for orthogonal functions g and h. 

2.1. The SVD Method 

Under the assumption that K is compact, there exist two orthonormal bases 
(SVD bases) (cfe) of H and {gk) of K, and a sequence (6^), 6^ — > as fc — > 00, 
such that 

K*Kek^blek, KK*gk^blgk, Kek^bkgk] K*gk^bkek 

with K* being the adjoint operator of K. 

The Singular Value Decomposition (SVD) of K 

Kf = ^bk{f, ek)gk 

k 

gives rise to approximations of the type 

N 

fe = Y.^k'{Ye,9k)ek, 

k=0 
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where N = N{e) has to be properly selected. This SVD method is very attrac- 
tive theoretically and can be shown to be asymptotically optimal in many situa- 
tions (see Mathe and Pereverzev together with their non linear counterparts 
Cavalier and Tsybakov Q , Cavalier et al Q , Tsybakov [33] , Goldenschluger and 
Pereverzev Efromovich and Koltchinskii [12]). It also has the big advan- 
tage of performing a quick and stable inversion of the operator. However, it has 
serious limitations: First, the SVD bases might be difficult to determine and 
handle numerically. Secondly, while these bases are fully adapted to describe 
the operator K, they might not be appropriate for accurate description of the 
solution with a small number of coefficients. Also in many practical situations, 
the signal has inhomogeneous regularitiy, and its local features are particularly 
interesting to recover. In such cases, other bases (in particular, localized wavelet 
type bases) are much more suitable for representation of the object at hand. 

In the last ten years, various nonlinear methods have been developed, es- 
pecially in the direct case with the objective of automatically adapting to the 
unknown smoothness and local singular behavior of the solution. In the direct 
case, one of the most attractive methods is probably wavelet thresholding, since 
it allies numerical simplicity to asymptotic optimality on a large variety of func- 
tional classes such as Besov or Sobolev spaces. 

To apply this approach to inverse problems, Donoho [lo| introduced a wavelet- 
like decomposition, specifically adapted to the operator K (Wavelet- Vaguelette- 
Decomposition) and utilized a thresholding algorithm to this decomposition. In 
Abramovich and Silverman this method was compared with the similar 
vaguelette-wavelet decomposition. Other wavelet schemes should be mentioned 
here, such as the ones from Antoniadis and Bigot Q , Antoniadis & al 0] , Dicken 
and Maass , and especially for the deconvolution problem, Penski & Vidakovic 
[ii]. Fan & Koo [H], Kalifa & Mallat [3], Neelamani & al [13]. Later on Co- 
hen et al [3] introduced an algorithm combining a Galerkin inversion with a 
thresholding algorithm. 

The approach developed here was greatly influenced by these works. 



2.1.1. Deconvolution 

The deconvolution problem is probably one of the most famous inverse problems, 
giving rise to a great deal of investigations, specially in signal processing, and 
has an extensive bibliography. In the deconvolution problem, we consider the 
following operator: Let in this case H = K be the set of square integrable periodic 
functions, with the standard L2[0, 1] norm, and consider 

f e Kf = [ j{u- t)f{t)dt e H, (3) 

Jo 

where 7 is a known function in H. It is generally assumed to be a regular 
function. A standard example is the box-car function which plays an important 
role in extending this model to image processing and especially to analysis of 
sequences of images. 
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In this case simple calculations show that the SVD bases Cfc and gk both 
coincide with the Fourier basis. The singular values correspond to the Fourier 
coefficients of the function 7: 

hk=lk- (4) 



2.1.2. Wicksell's problem 

Another typical example is the following classical Wicksell's problem [s^]. Sup- 
pose a population of spheres is embedded in a medium. The spheres have radii 
that may be assumed to be drawn independently from a density /. A random 
plane slice is taken through the medium and those spheres that are intersected 
by the plane furnish circles which radii arc the points of observation Yi, . . . , y„. 
The unfolding problem is then to determine the density of the sphere radii from 
the observed circle radii. This problem also arises in medicine, where the spheres 
might be tumors in an animal's liver (see Nyshka et al [2^), as well as in nu- 
merous other contexts (biological, engineering, etc.) see for instance Cruz-Orive 

a. 

The difficulty of estimating the target function is well illustrated by figure [TJ 
The Wicksell operator has a smoothing effect, thus the local variations of the 
target function become almost invisible in the case of observations corrupted 
by noise. (Also compare the blurred and noised observations in figure [5] to the 
target functions of figure [H) 





Fig 1. Heavisine function, its image by the Wicksell operator without and with gaussian noise 
with rsnr = 5 



Following Wicksell 34] and Johnstone and Silverman [1^, the Wicksell's 
problem corresponds to the following operator: 

H = L2([0,l],d/i), dfi{x) = {Axy^dx, 

K = L2([0,l],dA), dX{x) = A7:-\l-y^y^^dy, 



and 



Kf{y) = Jy(l - V2 j (^2 _ y2)-i/2;(^)rf^. 



In this case, following [18|, we have the following SVD bases: 
Ekix) = A{k + iy/''x^P°-\2x^ - 1) 

9k(y) = U2k+i{y)- 
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Here P^'^ is the fcth degree Jacobi polynomial of type (0, 1) and Uk is the second 
type Chebishev polynomial of degree k. The singular values are 

h-^il + k)-'^'. (5) 

In this article, in order to avoid some additional technicalities, we consider 
this problem in the white noise framework, which is simpler than the original 
problem described above in density terms. 

3. General scheme for construction of frames (Needlets) and 
thresholding 



Frames were introduced in the 1950's by Duffin and Schaeffer as a means for 
studying nonharmonic Fourier series. These are redundant systems which behave 
like bases and allow for a lot of flexibility. Tight frame that are very close to 
orthonormal bases are particularly useful in signal and image processing. 

In the following we present a general scheme for construction of frames due 
to Petrushev and his co-authors [2^, [3l|, [s^l • As will be shown this construction 
has the advantage of producing easily computable frame elements which are 
extremely well localized in all cases of interest. Following [26l 31 . 3^ we will call 
them "needlets". 

Recall first the definition of a tight frame. 

Definition 1. Let H fee a Hilbert space. A sequence (ipn) in H is said to fee a 
tight frame if 

11/11' = Ei</'^")i' ^/^H. 

n 

Let {y, fi) be a measure space with fi a finite positive measure. Suppose we 
have the following decomposition 



fe=0 



where the iJ/c's are finite dimensional spaces. For simplicity, we assume that Hq 
is reduced to the constants. 

Let {e^)i=i^...j^ be an orthonormal basis of Hk- Then the orthogonal projector 
Lk onto Hk takes the form 



Lkif){x)= I f{y)Lk{x,y)d^i{y), yfeUiy,t^), 

where 



Lk{x,y)=Y,e'l{x)e^{y). 
Note the obvious property of the orthogonal projectors: 

Lk[x, y)L.,n{y, z)dn{z) = Sk,mLk{x, z). (6) 
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The construction, inspired by the (^-transform of Frazier and Jawerth [l5| . 
consists of two main steps: (i) Calderon type decomposition and (ii) Discretiza- 
tion, which are described in the following two subsections. 

3.1. Calderon type decomposition 

Let (fi he a C°° function supported in [—1,1] such that < ip{£,) < 1 and 
ip{^) = 1 if ICI < i. Define a($) > from 

a2(O=^(e/2)-^(O>0. 

Then 

J2a\a^')^l, V|e|>l. (7) 
We now introduce the operator 

k>0 

and its associated kernel 

A,{x,y) = ^a2(fc/2J)Lfe(a:,2/) = ^ a\k/2^)Lk{x,y). 

k>0 2J-i<fc<2J + i 

The operators Aj provide a decomposition of L2(3^,/i) which we record in the 
following proposition. 

Proposition 1. For all f £ L2(3^, we have 

oo 

f = L^{f)+Y,A,U) L2(J,Ai). (8) 

i=o 

Proof. By the definition of Lk and ([7]) 

J J 

Lo + Y.A,=Lo+ ^^a2(fc/2-'")Lfc=^^(fc/2'^+i)Lfe (9) 

j=0 j=0 k k 

and hence 

||/-Lo(/)-5^A,(/)|p= J2 \\Li{f)r+ E \\Liif){l-^il/2'+')r 

j=0 i>2' + i 2J<l<2J + ^ 

< \\Li{f)f^O as J^oo, 

1>2J 

which completes the proof. □ 

3.2. Discretization 

Let us define 

k 
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We make two additional assumptions which will enable us to discretize decom- 
position ^ from Proposition [TJ 

(a) 

/ e /Cfc, g e ICi =^ fg e ICk+i- 

(b) Quadrature formula: For any fc G N there exists Xk a finite subset of y 
and positive numbers X,f > 0, rj E Xk, such that 

/ /dA* = V Xrjfiv) V/ e /Cfc. (10) 

(Obviously, #Xa = 1.) 
We define 

Af,(a;,y) =;^a(fc/2^)Lfe(x,y) for j > 0. (11) 

k 

Then as a consequence of ([6]), we have 

A,(a;,2/)= / Mj{x, z)M,{z,y)d^i{z). (12) 



It is readily seen that Mj{x, z) = Mj{z,x) and 

V a;, z I— > Mj{x, z) G /C2j+i_i and hence z i-^ Mj(x, z)Mj[z, y) G ]C2i+^-2- 
Now, by (dni) 

Ajix,y)= Mj{x,z)Mj{z,y)dfi{z)^ V A„M,(a:, r7)Mj (r/, ?/), 
which implies 

Aj/(x) = / Aj(x,2/)/(2/)d/i(y) = / V \^Mj{x,r])M^{rj,y)f{y)dtxiy) 

(13) 

= X! \/%Mj{x,r]) / f{y)^/\Mj{y,vi)d^.{y). 

We are now prepared to introduce the desired frame. Let = A'2j+2_2 for J ^ 
and Z_i = Aq. We define the frame elements (needlets) by 



= ^J\Mj{x, T]), T] G Zj, j > -1. (14) 

Notice that Z_i consists of a single point and -00 = 4'-i,ri, V G Z_i, is the 
L2-normalized positive constant. Now (fT3)) becomes 



Proposition 2. The family {^pj^ri)ri&j.j>-i is a tight frame for 1^2 {y, fJ')- 
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Proof. As 

/= lim Lo{f) + Y.A,{f) 

j=0 



we have 



But by HSl 



J 

\fr= lim (Lo(/),/>+^(A,(/),/>. 

j=0 



(A, (/),/) = J2 {Li^j,n){i^j,nJ) = E K/'V^^-,r,)l', J > 0, 
and since ipo is the normahzcd constant (io(/), /) = \{f, V'o)!^- Hence 

ll/lP = l(/,^o)P+ E K/'^.-.'^)^ 

jSNo, r,eZj 

which shows that (ipj.ri) is a tight frame. □ 
3.3. Localization properties 

The critical property of the frame construction above which makes it so at- 
tractive is the excellent localization of the frame elements (needlets) (V'j,?)) in 
various settings of interest (see 25, 2^ 31, Is^])- The following figure (due to 



Paolo Baldi) is an illustration of this phenomenon. The rapidly oscillating func- 
tion is the Legendre polynomial of degree 2^, whereas the localized one is a 
needlet constructed as explained above using Legendre polynomials of degree 
< 2^* and centered approximately at zero. Its localization is remarkable taking 
into account that both functions are polvnomials of the same degree. 




G. Kerkyacharian et al./NEED-D: estimation in inverse problems 



39 



In the case of the unit sphere in where are the spaces of spherical 

harmonics, the following localization property of the needlets is established in 
Narcowich, Petrushev and Ward 25|, |26| : For any k £ N there exists a constant 
Ck such that: 

- [1 + 2^ arccos<r;, 

In the case of Jacobi polynomials on [—1,1], the localization of the needlets 
proved in Petrushev, Xu 3l| takes the form: For any k E N there exists a 
constant Ck such that 



IV'i>)(cos( 



< 



Cfe2^-/2 



(1 + 2i\d - arccos 77 1 ) y/wa^f3 (2J , cos 6*) ' 



1^1 



where Wa.,0{n,x) = (1 - a; + n-2)"+i/2(i + 3, + „-2)/3+i/2 anda,/3> -1/2. 

The almost exponential localization of the needlets and their semi-orthogonal 
structure allows to use them for characterization of spaces other than L2, in 
particular the more general Triebel-Lizorkin and Besov spaces (see 26l. l31jV 



3.4- NEED-D algorithm: thresholding needlet coefficients 

We describe here the general idea of the method. The first step is to construct a 
needlet system (frame) : ?7 € "^jij ^ ~1} described in section[31 where 
Hk is simply the space spanned by the fc-th vector Ck of the SVD basis. 
The needlet decomposition of any / G H takes the form 

Using Parseval's identity, we have /3j,, = (/, '0j>,)h = Y.i fi'^]r, '^it^^ h = (/' ej)H 
and ^Z"]^ = ('0j,),ei)H- If we put Yi = {Ys,gi)K, then 

= {Kf, g^)K + ££,t = (/, K*g,)K + = (^ fjej,K*gi)u + e^, = bj, + e^i, 

j 

where = (W,gi)K form a sequence of centered Gaussian variables with vari- 
ance 1. Thus 

i 

is an unbiased estimate of Notice that from the needlet construction (see 
the previous section) it follows that the sum above is finite. More precisely, 
-iP^.^ ^ only for 2^-^ < i < 2^+\ 

Let us consider the following estimate of /: 

,7 
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where < is a thresholding operator defined by 

t0]v) = PjvHlPjvl > l^te^Tj} with (16) 



i,=e^logl. (17) 

Here k is a tuning parameter of the method which will be properly selected later 
on. Notice that the thresholding depends on the resolution level j through the 
constant aj which will also be specified later on, and the same with regard to 
the upper level of details J. Notice also that, in this paper, we concentrated on 
hard thresholding, whereas various other kind of thresholdings could be used, 
likely giving comparable results at least theoretically. 

We will particularly focus on two situations (corresponding to the two exam- 
ples discussed above). In the first case (see subsection!?]), the needlets have very 
nice properties and behave exactly like wavelets. This is for instance the case 
of the deconvolution, where the SVD basis is the Fourier basis. However, more 
complicated problems e.g. the Wicksell's problem exhibit more delicate concen- 
tration properties for the needlets giving rise to different behaviors in terms of 
rates of convergence for the estimators. 

4. NEED-D in v^ravelet scenario 

In this section, we assume that the needlet system has the following properties: 
For any 1 < p < oo, there exist positive constants Cp, Cp, and Dp such that 

Card < C2\ (18) 

Cp2^'^«-^^ < < Cp2^(«-'\ (19) 

II 5Z "'j'^J'jIlp -^P^ l"»?rilV'j>)llp, for any collection (w^). (20) 

We define the space ^ as the collection of all functions / with / = 
Ej>o T^vez, Pjn^3v such that 

II/IIbj., ll(2^'[^+^-^l||(/3,,),ez,||iJ,>o||;. < oo, and (21) 
f^Bl,{M) ^ II/IIb;,^ <M. (22) 

Theorem 1. Let 1 < p < oo, 2v + 1 > 0, and 

'rl.^snpJ2[^r<C2'^-^,yj>0. (23) 



Suppose > 16p and 2'-^ = [t^] ^"+^ with t^ as in l\16} . 

Then for f G B^^^{M) with tt > 1, s > l/n, r > 1 {with the restriction r < n 
if {v+ i)(| - 1)), we have 



m - m < ciogii/er-'[e^iog(r/F)r, (24) 
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where 



S + 1/ + 1/2 — l/TT TT 2 TT 

The proof of this theorem is given in section [T] 
Remarks : 

1. These results are essentially minimax (see Wilier (s^) up to logarithmic 
factors. We find back here the elbow, which was already observed in the 
direct problem, as well as in the deconvolution setting (see [l7i], for in- 
stance) . 

2. Condition ([^5]) is essential in this problem. In the deconvolution case, the 
SVD basis is the Fourier basis and hence tpj^^ are simply the Fourier coef- 
ficients of ipjjj . Then assuming that we are in the so-called "regular" case 
{bk ~ k~'^, for all fc), it is easy to show that (|23p is true for the needlet 
system as constructed above (see also the discussion in the following sub- 
section). A similar remark can be made regarding conditions (I19p and ()20p . 
In the deconvolution setting, the needlet construction is not strictly needed 
and, as is shown in Johnstone, Kerkyacharian, Picard, Raimondo[l3|, the 
periodized Meyer wavelet basis (see Meyer [2J] and Mallat [2^]) can re- 
place the needlet construction. Condition (1231) also holds in more general 
cases such as the box-car deconvolution, see (l7| , [l^ where this algorithm 
is applied using Meyer's wavelets. O 



4.1- Condition I123\) and the needlet construction 

The following lines are intended to a posteriori motivate our decision to build 
upon the needlet construction. As was mentioned above condition ([23|) is very 
important for our algorithm. The proof will reveal that it is essential, since cr| is 
exactly the variance of our estimator of f3jri, so in a sense no other thresholding 
strategy can be better. 

Let us now examine how condition (j23p links the frame (ipjrj) with the SVD 
basis (cfc). To see this clearly let us suppose that {ipjri) is an arbitrary frame 
and let us place ourselves in the regular case: 

(this means that there exist two positive constants c and c' such that c'i^'^ < 
bi < ci^'^). If condition ([23]) holds true, we have 

m 2™<i<2™+i-l * 
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Hence, V m > j, 

2'"<i<2"^+i-l 

This means that the energy of tp^^^ decays exponentially for i > 2^ , which reveals 
the role of the Littlewood Paley decomposition in the previous construction, 
replacing the exponential discrepancy by a cut-off. 

The following proposition establishes a kind of converse property: The con- 
struction of needlet systems always implies that condition is satisfied in the 
regular case. 

Proposition 3. // (ipj^n) is a frame such that {i : -0],, 7^ 0} is contained in a 
set {Ci2J , . . . , C2 2^}, and h ^ i^" , then 

Proof. Since the elements of an arbitrary frame are bounded in norm and "0*^ 7^ 
only for Ci2J < i < C22^ , we have 

Y^i^f < C22^ni^j-,^ll' < C'22^^ 

□ 



5. NEED-D in a Jacobi-type case 

Properties P^ - (P0)) are not necessarily valid for an arbitrary needlet system, 
since as mentioned above the localization properties of the frame elements de- 
pend on the initial underlying basis, and hence on the problem at hand. We will 
consider here a particular case motivated by Wicksell's problem. 

We consider the space H = L2(/, dj{x)), where / = [—1, 1], ^7(0;) = u!a,i3{x)dx, 

tOo^A^) = Ca,/3(1 - + xf, a,l3> -1/2, 

and Ca,p is selected so that d'^a,f}{x) — 1. We will assume that a> (3 (other- 
wise we can interchange the roles of a and (3). 

Let (P/c)fc>o be the L2(/, ^7(0;)) normalized Jacobi polynomials. We assume 
that the Jacobi polynomials appear as an SVD basis of the operator K. This is 
the case of Wicksell's problem, where /3 = 0, a = 1, 6^ '--^ fc^^^^. 

In the Jacobi case, the needlets have been introduced and studied in Petru- 
shev and Xu [sij . See also the appendix, where the definition and some impor- 
tant properties of Jacobi needlets are given. 

We will state our results in a more general setting, assuming that only a 
few conditions on the needlet system are valid. Note that these conditions are 
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fulfilled by the needlet system (Jacobi needlets) constructed using the Jacobi 

polynomials {Pk)k>a- The proofs arc given in the appendix. 

We will consider two sets of conditions. The first one (which only depends on 
a) is the following: 

Card Zj < 2^ (25) 

E ll^^-^llp ^ ^P^'"^' V 2^(f-2)(i+"), Vj, Vp ^ 2 + (26) 

II E < C( E WW'^iAlf'"- (27) 

We define the space ^ as the collection of all functions / on [—1, 1] with 
representation 

such that 

ll/IISj,. ^= ll(2''(E l/3.,';ril^.,^Ji:)'^").>-ill'. < and (28) 
fGK^AM) ^ \\fh.^<M. (29) 

In the Jacobi case, ^ is the Bcsov space defined in the Appendix as a space 
of approximation (not depending on the special needlet- frame). 

Theorem 2. Let 1 < p < oo and a> (5 > Suppose 



= e A/log l/£ and 2"^ = te '+^'' . 

a _ \/ (i - §±2 

-2 p )+ ^ \2 p 



Let > 16p[l + 4{(f - ^)+ V (f - ^)+}] and assume that we are in the 



regular case, i.e. 



Then for f G B^^^{M) with s > [i - 2(a + l)(i - i)]+, we have 



nf - m < c[iog(i/£)]p-i[eVMiM]''^ 

where 

{i) ifp <^+-^^, then 



S + l'+ ^ 



{ii) ifp>2+-^^, 



then 



^ s + i/+(a + l)(l-|)- 
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Remarks : 

1. In the case » < 2 H tttt^, the rate obtained here is the usual one, and can 

be proved to be minimax (see [11]). The case p > 2 + a+\j2 introduces a 
new rate of convergence. 

2. Conditions (P5l) - (P7)) enabled us to estimate the rates of convergence of 
our scheme, whenever the index tt of the Besov space is the same as the 
index of the loss function (p = tt). In the sequel, we will study the case 
where p and tt are independently chosen. This requires, however, some 
additional assumptions. O 

If in addition to properties (P5)) - l|?7|) . we now assume that the following 
conditions are fulfilled: For any rj G Zj, j > 0, 

c2^(P-2)(a+l)^(^)-(p-2)(a+l/2) < < ^2^(p-2)(a+l) ^(^)-(p-2)(a+l/2) ^ 

Hv) < 2^-\ (30) 

^2Kp-2)(,3+1)^/(^^)-(p-2)(/3+1/2) < ||^^.^||p < ^2^(p-2) ^/ - (p-2) (/3+1/2) ^ 

fc'(?7) = V - k{r]) < 2^-\ (31) 

where k{ri) E {!,..., 2-'} is the index of r/ e Zj. Here we assume that the 
points in Zj are ordered so that rji > ri2 > ■ ■ ■ > rj2i ■ Note that in the case of 
Jacobi needlets Zj consists of the zeros of the Jacobi polynomial P!^^^ (see the 
appendix). In the following we will briefly write k instead of kiif) and k' instead 
of k'{r]). Of course, ((26|) is now a consequence of conditions ([30ll - ([3T|) . 

Observe the important fact that properties ([30|) -([3T |) are valid in the case of 
Jacobi Polynomials (see the appendix). 

Theorem 3. Let 1 < p < oo and a > j3 > Suppose that conditions 

and are fulfilled. Let 

2' = t:^ and «2>i6p[l + 4{(^-^)+V(f -^)+}] 

2 p 2 p 

and suppose that we are in the regular case, i.e. 

bi ^ I , 1^ > --. 

Then for f e K,^{M) with s > max^g|„,^}{i - 2(7 + l)(i - i) V 2(7 + 
l)(i - i) V 0}, we have 

< C[logil/e)r-'+-[ey/l^i(l/r)r, (32) 

where 

/X = min{/i(s), p(s,a), /i(s,/?)} and a = max{a(a), a{/3)} < 2 with 
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m(s,7) = 



1 ' 

2 



.-2(l + 7)(^-|) 
: + i. + 2(l + 7)(i-i) 



and, 



I{Sp = 0} z/b-^][l-(p-2)(7 + l/2)]>0, 

''^^^"1 I?^iySfelFT + ^a-0} z/b-7r][l-(p-2)(7+l/2)]<0, 

with Sp = l- (p- 2)(7 + 1/2) and (5^ = s[l - (p - 2)(7 + 1/2)] - p(2i^ + 1)(7 + 
!)(---)■ 

The proofs of Theorems [2] and [3] are relegated to section [8l 
Remarks : 

1. Naturally, Theorem [2] follows by Theorem [3l We stated this two theorems 
separately because the hypotheses of Theorem [2] are less restrictive than 
the conditions in Theorem [3] and hence Theorem [2] potentially has wider 
range of application than Theorem [3) 

2. It is interesting to notice that the convergence rates in (|32|) depend only 
on three distinctive regions for the parameters (which are actually present 
in Theorem [51 but hidden in the condition a > f3), which depends on a 
very subtle interrelation between the parameters s, a, (3, p, tt. 

3. It is also interesting to note that the usual rates of convergence obtained 
e.g. in the wavelet scenario are realized in the extreme case a — f3 = 

O 



6. Simulation study 

In this section we investigate the numerical performances of the NEED-D es- 
timator in the context of the Wicksell problem described in section [2.1.21 We 
compare the results for simulated datasets to those obtained with several SVD 
methods. 

6.1. The estimators 

6.1.1. Singular value decomposition estimators 

With the notations introduced before, / can be naturally estimated by the fol- 
lowing linear estimator based on the singular value decomposition of operator K: 

where is a deterministic filter. 
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In the simulations a first SVD estimator with projection weights was used: 

jXi =1 ifi<N, 
\Xi =0 ifi>7V, 

where the parameter N was fitted for each setting so as to minimize the root 
mean square error {RAISE) of the estimator. 

We also use the SVD estimator developed in Cavalier and Tsybakov [6| , which 
is completely adaptive with a data driven choice of the filter and thus much more 
convenient than the former in practice. The values of are constant in blocs 
Ij — [kj-i, Kj — 1] with limits kq — 1 and kj = N + I determined further: 

■^4y^)+ if j e /j, j = 1,. .. j, 




where: 



if i > AT, 



A, = — 0<7<1A 



and we used the notation — max(0, x) 



The blocks are determined by the following procedure. Let 
max(5,loglog(I/£)) and = j^^^, we define: 



Kj 


= 1 


a J 


= 0, 


Kj 


= l^e 




= 1, 


Kj 






= 2, . . . , J, 



where J is large enough such that: kj > max{m : X]i=i < e ^p^ '^}. 

In the simulation settings considered further the value taken by kj = + 1 
is too large compared to the level n of the discretization resolution, thus the 
estimation was performed at the level A'o = min N) instead of N. 

6.1.2. Construction of the needlet basis 

Every needlet V'i.?)^ defined on / = [—1,1] is a linear combination of Jacobi 
polynomials as described in section [31 with weights depending on some filter a. 
This function is chosen as: 



i{x) = \/(^(a;/2) - ip{x), Vx > 
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where ip{x) = I{x < 0.5} + P{x)I{0.5 < a; < 1} and P is a polynomial adjusted 
such that the corresponding needlet is sufficiently regular. In practice this choice 
seems to be slightly better than a C°° filter with exponential shape. 

The shape of a is given by figure [H and some examples of needlets are given 
in figure [31 Their amplitudes and supports fit automatically to the location of 
77: the needlets located near the edges of / are much sharper than those located 
in the middle. 




0.5 1 1.5 2 2.5 3 

Fig 2. Filter a with polynomial shape 




-1 -0.7 -1 1 -1 1 0.7 1 

Fig 3. Examples of needlets: V'7,»?io> '^'^,ViO' '^'^,v«o ''"'^ V'7,'7120 (from left to right) 



Finally NEED-D is performed by using the following basis {ipj.ri) adapted to 
the Wicksell problem: 

Va; e [0, 1], ^j,rjix) = 4V2a;2Vj,^(2a;2 - 1). 

With such a basis we have for all i G N: 

^■,=a(*/2-'"-i)F,(r7)V6^, 

thus the estimated coefficients of / in the frame are very easy to compute. 

6.2. Parameters of the simulation 

We consider the four commonly used target functions / represented in figure |31 
and three levels of noise a corresponding to three values of the root signal to 
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Blocks Bumps Heavisine Doppler 
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0.5 
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-0.5 






-0.5 





0.5 1 0.5 1 0.5 1 0.5 1 

Fig 4 . Target functions 

noise ratio of K{f): rsnr e {3, 5, 7}. The discretization resolution level is set to 
n = 1024, and the constant 77 in the thresholds of NEED-D is set to 77 = 0.75a/2. 

The estimation error is evaluated by a Monte Carlo approximation of several 
losses: 

n 

• LI is computed as the average over 20 runs of i ^ \ f{—) ~ f{~)\/{~)- 

" 1= 1 " " " 

• RAISE is computed as the average over 20 runs of ^ j-^ - fijiW/if)- 

In each run, the gaussian noise component is simulated independently of its 
values in the other runs. 

6.3. Analysis of the results 

The performance of the non adaptive SVD estimator depends very strongly 
on the choice of N (see figure [5]). A large N is needed in the case of small 
noise (first row of the figure) and in the case of very oscillating functions such 
as Doppler and Bumps. However even with this optimal a posteriori choice of 
A^, the adaptive filter leads to better results than the non adaptive projection 
weights as shown in tables [T] and O Indeed the former is more adapted to the 
ill posed nature of the problem and to the variations of the noise, by adjusting 
over the singular values (bk) and the data (yk)- 

Moreover the NEED-D estimator generally outperforms both SVD estima- 
tors. As can be seen on figure [6l the differences are obvious in high noise for 
the Bumps and Doppler targets, where the SVD estimators are very noisy (in 
fact all the estimators happen to leave some noise unfiltered near the right edge 
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Fig 5. Value of the mean square error of the non adaptive SVD estimator (y-axis) for each 
value of N (x-axis) for rsnr = 7 to rsnr = 3 (from top to bottom) and for the target function 
Blocks, Bumps, Heavisine and Doppler (from left to right) 



of the interval, which is given lesser importance by errors measured with the 
weight fi{x) — l/{Ax), for x g]0, 1].) This order of comparison is confirmed by 
the lower values of LI and RMSE for NEED-D than for SVD in aU the settings 
(see tables [T] and [2]) . 





SVD 

low med high 


Adaptive SVD 
low med high 


NEED-D 
low med high 


Blocks 
Bumps 
Heavisine 
Doppler 


0.0452 0.0495 0.0677 
0.0324 0.0388 0.0463 
0.0257 0.0305 0.0402 
0.1032 0.1138 0.1307 


0.0399 0.0465 0.0591 
0.0258 0.0295 0.0361 
0.0248 0.0299 0.0401 
0.1002 0.1085 0.1230 


0.0347 0.0404 0.0511 
0.0180 0.0206 0.0270 
0.0205 0.0254 0.0321 
0.0858 0.0909 0.1007 



Table 1 

Error LI for each target, each noise level and each estimator 
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0.1 
0.05 


-0.05 



^ 0.051 1 "■^r 

>^ JfA^ ° [Vm 



0.1 




0.5 1 0.5 1 0.5 1 0.5 1 



-1 
1 



-1 

0.5 1 0.5 1 0.5 1 0.5 1 
1 



1 


-1 



0.5 1 0.5 1 0.5 1 0.5 1 








0.5 1 









0.5 1 




\A 





0.5 1 


■4} 





Fig 6. From top to bottom: observed data, NEED-D estimator, adaptive SVD estimator and 
non adaptive SVD estimator for high noise (rsnr=3) 

7. Proof of Theorem [T] 

In this proof, C will denote an absolute constant which may change from one 
line to the other. 





SVD 

low med high 


Adaptive SVD 
low med high 


NEED-D 
low med high 


Blocks 
Bumps 
Heavisine 
Doppler 


0.0714 0.0790 0.0959 
0.0489 0.0577 0.0706 
0.0278 0.0327 0.0422 
0.1092 0.1200 0.1378 


0.0665 0.0743 0.0900 
0.0453 0.0508 0.0617 
0.0266 0.0317 0.0418 
0.1042 0.1114 0.1258 


0.0606 0.0673 0.0816 
0.0378 0.0416 0.0523 
0.0235 0.0288 0.0379 
0.0969 0.0999 0.1071 



Table 2 

Error L2 for each target, each noise level and each estimator 
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First we have the following decomposition: 
J 

m m < s^'-heii E E w^v) - + II E E f^Jvi^^X} 

^■.I + II 

The term // is easy to analyse, as follows: Since / belongs to r-(-^)i using 
standard embedding results (which in this case simply follows from direct com- 

parisons between Iq norms) we have that / also belong to Bp,r " (M'), for 
some constant A/'. Hence 

iiEE/5^''V',',iip<c2-^''^-(i-^)+i. 

j>J jyeZj 

«-(---)+ 

Then we only need to verify that — ,^+1/2 — always larger that ^, which is not 
difficult. 

Bounding the term I is more involved. Using the triangular inequality together 
with Holder inequality, and property ([20| for the second line, we get 

J 

/ < J^--! E E|| E - P^v^^jJl 

,7 

< 2^-\p-^c E E nmv) - Pjnm^nWi- 

Now, we separate four cases: 
J 

j=-lriel.j 

= E E ''^i*(^^')) - (^^vn^ivWilimr,] > Kt,<j,}+i{\ff,^\ < Kt,a,} 

i=-lr)eZj 

J r 



^E E 



<: Bb + Bs + Sb + Ss. 

If we notice that jSjrj — (ij^-i — = ^X^i'^j'^ ^ gaussian ran- 

dom variable centered, and with variance £^X]J%^]^j have using standard 
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properties of the gaussian distribution, for any q > 1, if we recall that we set 

a'j =: X]J%^]^ — C2^^'^, and denote by Sq the qth absolute moment of the 
gaussian distribution when centered and with variance 1: 



Hence, 



J 



And, 



J 

3 = -lr,eZj 



J 

Now, if we remark that the (3jri are necessarily all bounded by some constant 
(depending on M) since / belongs to B^ j.{M), and using (fT9|) . 

.7 

5& < E E \Pjvmjv\m\P]v - Piv\ > 2^t,<j,}I{\f3,,\ > 2Kt,a,} 
J 

< E E l^^')l'll^^')ll?2e'''/'^{l/3..l>2A^iete^,} 



8 (21. + 1) 



It is easy to check that in any cases if > 16p the terms Bs and Sb are 
smaller than the rates announced in the theorem. 
If we recall that: 
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We have using (fTO]) and condition ([23|) for any 2: > 0: 

j=-l rieZj 

J 

j=-l rieZj 

J 

3 = -l r/GZj 

Also, for any p> z >Q 

J 

So in both cases we have the same bound to investigate. We will write this 
bound on the following form (forgetting the constant): 

30 

I + 11 = tP-'-'[Y 2^['^(P-"i)+5-il E 
j=-i jjeZj 
J 

j=jo + l J)6Zj 

The constants and Jq will be chosen depending on the cases, with the only 
constraint p > Zi > 0. 

Notice first, that we only need to investigate the case p > tt, since when 
p < TT, BUM) C B;^{M'). 

Let us first consider the case where s > {1^ + |)(^ — 1), put 

_ p(2;/+l) 
^~ 2(s + i^) + l 

and observe that on the considered domain, q < tt and p > g. In the sequel it 
will be useful to observe that we have s = (i^ + ^){^ — !)• Now, taking Z2 = tt, 
we get: 

,7 

Now, as 

pi /P , N 11 



G. Kerkyacharian et al./NEED-D: estimation in inverse problems 



54 



and 

with {Tj)j G Ir (this last thing is a consequence of the fact that / e ri-^'^) 
and item (5)), we can write: 

II <t/-'' J2 2^P(i-t)(''+^'r/ 

The last inequality is true for any r > 1 ii n > q and for r < n if n = q. Notice 
that TT = g is equivalent to s = {2v + 1)(^ — \)- Now if we choose jo such that 
2^0 f ('^+3) ^ t^-i we get the bound 



which exactly gives the rate announced in the theorem for this case. 

As for the first part of the sum (before jo), we have, taking now zi — q, with 

q< TT, so that [~J2r,ez, If^ivl'']" < E,,ez, If^jvH^ ^ and using again (H), 

jo 



-1 

jo 



-1 rjeZj 
_ jo ~ - 



-1 



< C'f^p-'32^°'''^+^''^''^^?''l 

< Ci/~« 

The last two lines are valid if q is chosen strictly smaller than q (this is possible 
since tt > q). 

Let us now consider the case where s < {2v + 1)(^ — 5), and choose now 

P(s+---) 

In such a way that we easily verify that p — q = g^^^j^i^i a-nd q — tt = 
(p-7r)(i+^)-s^ Furthermore we also have s + i - i = - i + iy(H - 1). 
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Hence taking zi = w and using again the fact that / belongs to B^^r{M), 



30 



-1 r;eZj 
30 



< 



-1 



This is true since + 5 ~ ^ is also strictly positive because of our constraints. 
If we now take 2'"'9^'^^2~ p) ^ ^^-i we get the bound 

which is the rate announced in the theorem for this case. 
Again, for //, we have, taking now Z2 = q > q{> tt) 



8. Proof of the Theorems [2] and [3] 

The proof essentially follows the same steps as in the previous section. However, 
the following proposition will be helpful in the sequel. 

Proposition 4. Let us suppose that the following estimates are verified: Under 
the conditions LSOl) and 1131]) . we have 
1. 



TT > p 


^&3vn 

V 




)^/^<(E i/3..rii^.,.ii^)'/'^ 


n < p 


- ( E 

)),/£(r))<2J 


\P3V\ 

-1 






^ ( E 

i),fc(»))<2J 


-1 




TT < p 


- ( E 

i),fc(j7)>2J 


-1 






^ ( E 

)),*:(r))>2j 


-1 
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Proof. • If TT > p clearly, because, CardZj < 2-', 

But, using dSO]) and (pT]) . 
So 

(E i/^.'<riiV'...iip'/^ < (E i/^.'riiv^x.ii:)'/" 

• If TT < p, clearly 

( E i/3..ni^.,.iip'/' < ( E 

?7,fe(?;)<2J-i i7,fc(?))<2J-i 

But 
Hence, 

»j,fe(?j)<23-i r;,fe(77)<2J-i 

The proof of the inequality with /3 instead of a obviously is identical. 

□ 

Going back to the main stream of the proof, we first decompose: 

iEii/-/ii^ < 2^'-heii E Ew/5^'>)-/5^'>)^^'>iip + iiEE/5^'>^^-''iip} 

=: / + // 
• For //, using (|77)) . 

II E E /3..^^.ii? < (E II E /^^v^M' < ^^E(E Wf^Mi'iy^T 

j>Jri&j j>J rieZj j>J r;GZj 

If TT > p, if we put 5 = Yq^, using / e B^^^{M), 

II < C2-''''P ^ Ct^/P 
li TT < p, we decompose // in the following way 

j>J )),fe(r))<2J-i 

+E( E iP^vm^vV'^T} 

j>J r;,fe(jj)>23-i 

:= II{a)+II{P). 
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Now, using (jl]), and / G Bp ,.{M), 

II{a) < C[Y^ 2"J"'2J'2("+i)(i/''"i/P)]P 
j>J 

If s > 2(a + l)(l/7r- 1/p) 

11(a) < C2"-'(''"^("+l)(^/''"^/P))'' = (j^S{s-2{a+l)il/TT-l/p))p ^ 

The term can be treated in the same way. 

• For / 

Using the triangular inequahty together with Holder inequality, and (|27p for 
the second line, we get 

J 

j=-l rjeZ, 

J 

< 2P~ijP-iC[/(a) +/(/?)] 

In the last line we separated as previously, in the sum rj G Zj, the indices 
k{r]) < 2^^^ and k{ri) > 2^^^. We will only investigate in the sequel /(a), since 
the argument for goes in the same way. 
Now, we separate four cases: 



J 

j=-l ri,k(r])<20 
J 

j = ?7,fc(j7)<2J-i 

J 



E 

j = -l ?7,fe(j7)<23-i 



+ \f3,,mjvrpim,\ > ^t,<j,}(^I{\(3,,\ > 2Kt,a,-\ + /{|/3,,| < 2Kt,a,-\ 
<: Bb + Bs + Sb + Ss 

If we notice, as before, that Pj^j ~ Pjr, — J2i ^^"T^^jr; = ^X^i^*"^ ^ gaus- 

sian random variable centered, and with variance E^X^il'T^)^' have using 
standard properties of the gaussian distribution, for any q > 0: 
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Hence, 



j=-l r,,fe(jj)<23-i 
J 



Ss < J2 E l/9,>,ni^,r,||^/{|/3,,| <2«£^logia,} 
And, 



Bs < 



< 



j = -l ?7,fc(r,)<23 

< c'e^e'^^/i'' E 2'"' E ll^^-'^llp 



using (l26l) . Now, if we remark that the /3j,, are necessarily all bounded by some 
constant M, since / £ Bp^{M), 

J 

sh < E \PMo4in\P]v-P3n\ 



< E E l/3,.niV',.l!^ce«'/'/{|/3,,|>2A^£^logia,} 

< ^^^^'^ E E 
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It is easy to check that in any cases for large enough, the terms Bs and 
Sb are smaher than the rates announced in the two theorems. 



Now we focus on the bounds of Bb and Ss. Let q e [0,p], we always have: 

i=-lj7,fe(j7)<23-i ^ 
j = ~l jj,fe(j7)<2J-i 



And 



J 

E E iPsvm.vFpimvi < 2«^e^,} 

j=-l r),fe(?))<2J-i 



So like in the wavelet scenario we have the same bound to investigate: 
J 

j = -l 77,fc(7;)<2J-i 

then we use and we separate as before the bound obtained in two terms A 
and B with some parameters joi -Zi and Z2 determined later, depending on the 
cases: 

j = -l 7;,fe(77)<23-i 
.7 

B:= (te^Tjf""^2-''(P-2)(a+l) ^ |^^^|,,^_(p_2)(„+l/2)^ 

j=io + l r;,fc(r;)<23-i 



Lei MS /irsi suppose that p < n and (p — 2) (a + 1/2) < 1, or that p > it and 
(p-2)(a + l/2) > 1. 
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Then we take zi=Q and Z2 = p, and let us denote Sp = 1 — (p — 2)(a + |). We 
have: 

30 

A = ^ 2^'(P-2)("+i) ^ ^-(p-2)(«+i/2) 

j=-l 77,/s(r;)<2J-i 
jo 



= ^ (f^CTj)^'2-'(P/2)V(p-2)(a+l)j-7(5p=0) 

< (7(tea,Jf2^°(f/2)v(P-2)(«+i)(log l)^(5.=o). 
And by treating B as was done previously with the term 1 1 {a), we obtain: 



if p < 

yields: 



So if p < TT and (p - 2)(a + 1/2) < 1 we set 2^° = ^/^^+''+^^\ which 



^ + B<Ci^^+^(log-)^(^''=o), 

e 

and ifp > TT and (p-2)(a+l/2) > 1 we take = ^j^-^j^ 
yields: 



-2(a + l)( 



A + B < Ci^^+^+f^+^X-^) (log i)/(5.=0) _ 

In the other cases: p < w and {p— 2) {a+ 1/2) >l,orp>iT and {p—2){a+l/2) < 
1, let us set q = (^Z2)(a+i/2)-i ^' '^^^ich satisfies: 

2(a + l)(7r-p) ^ 7r(a+ l/2)(7r-p) 

p — q=-, -TT — -, and tt — q = 



(7r-2)(a + l/2)-l' " (tt - 2)(a + 1/2) - 1 ' 

so q G]0,pA 7t[ under the assumptions made above. 

Let us bound the quantity J^nMnX'^^-' l/^j^l"^"^^"^^^""^^/^^ • We define: 

6i = -^{n-2){a + l/2), and 62 = -{p - 2){a + 1/2) - 6i. 

TT 
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Using Holder inequality, (|30p. and the fact that / G Bp^^{M), we have: 

7),fe(r))<2J-i 

r;,fe(?7)<23-i rj ,k(i)) <2i - 

i),fc(?))<2J-i 

^ (72--''(p-2)(Q+i)2j(-s«+^)ji-f ^ 
In the last line we used the fact that: 

{p-2){a + l)-sq-^{-K-i){a + l) = -sq+?^, and 



TT 2 TT — gr 

1. Let us assume that: 

-sq+{p- q){v+'^) <0, 

i.e. that: 

-S7r[(p - 2)(a + 1/2) - 1] + (a + 1)(^ - p){2y + 1) 

(7r-2)(a + l/2)-l " 

Then we take zi — Q and 2:2 = 9: 

Jo 

A - ^ (i.ajf 2J"(f-2)("+i) E fc-(''"2)(a+i/2) 

J = -l Jj,fc(7;)<2J-i 
< (ieCrjJ''2-'"(*'/^^'^(^~^^^"+^\ 

J 

i=jo + l i7,fe(?))<2J-i 
,7 



If {p - 2)(a + 1/2) > 1 we take V° = U ^'^'+''+'^"+^'^^^ ^^">\ which yields: 

s-2(Q + l)(J:-i) 

A + S<Ci'=+^+'°"^'<^-*'(logi)i-*, 

e 
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and if (p - 2) (a + 1/2) < 1 we take 2^° = t7^'^^^"^^\ which yields: 



A + B<Cte '(log 
Notice that, because of our conditions on s, we always have jo < J- 



2. Let us now assume that: 

-S7r[(p - 2){a + 1/2) - 1] + (a + l)(7r - p){2v + 1) 
(7r-2)(a + l/2)-l 

Then we take zi= q and Z2 = p- 

30 

A < C[Y^ (ie(7j)f-«2J(-««+^)] Ji-* 
j=-i 

< C(iea,J^'-«2^°(-««+^)(l0g -)!-*, 



> 0. 



£ 



and as before with the bias term 11(a): 



i=io + l r),fc(r;)<23-i 

If TT > p we take 2^« = which yields: 



A + B<Ct/^''^^ (log-)'-*, 
and if TT < p we take 2^° = i-Vk+''+(«+i)(i-f )]^ ^j^j^g. 

^_2(„ + l)(i,_i) 



A + B<Ct/™"^"^-^'(log^)i 

3. Let us finally assume that: 

-S7r[(p - 2)(a + 1/2) - 1] + (a + l)(7r - p)(2i/ + 1) = 0. 
We take Zi = q and Z2 = p as previously: 

Jo 

A + B < C £ tr«ii-*+C2-J°*-2(«+i)(i-i)+l 



1 



2-f I r^O-Jop[s-2(a+l)(A-i)+] 



< Cir''(log-) "+C2 

We proceed exactly like in the previous case, and we obtain the same rate 
whether tt > p or tt < p: 



A + B<Cie^^(l0gi)2 
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We can sum up all the results for Bb and Ss (and thus on I (a)) very simply: 

if 2{a + - i) < s and s[l - (p - 2)(a + 1/2)] < p{2:. + l){a + l)(i - i) 
then: 

s + 2(c + l)(i-i) 

Bh + bs<Cte (log-) , 

e 

if s[l - (p - 2)(a + 1/2)] > p(2iy + l)(a + l)(i - i) then: 

Bb + S-s < C<e (log -)", 
where the power of the log factor depends on the parameters: 

_ r /{5p = 0} if b-^][l-(p-2)(a + l/2)]>0, 

""1 (.^-2)^^+im-^ +I{5s = Q} if b-^][l-(p-2)(a + l/2)]<0, 

with 5p = 1- (p-2)(a + l/2) and 5s = s[l - (p - 2)(a + 1/2)] - p(2i/ + l)(a + 
!)(---)■ 

Note that the first term in the second case is bounded by 1 , so we have a < 2 
whatever the case. 

9. Appendix: Needlets induced by Jacobi polynomials 

The main references for this appendix are the two papers [31| of Petrushev and 
Xu, and |2l| of Kyriazis, Petrushev and Xu. 

9.1. Jacobi needlets: Definition and basic properties 

In this section we apply the general scheme from fJ3] for the construction of 
Jacobi needlets. We begin by introducing some necessary notation. We denote 
I = [—1, 1] and dja.pix) — Ca.f3U!a,p{x)dx, where 

tj„.;3(x) = (l-x)"(l + x)''; a, 13 > -1/2, 

and Ca,/3 is defined by Jjd'-fa,f3{x) — 1. Assume P"'^ are the classical Jacobi 
polynomials (cf. e.g. [12]). Let Hj!''^ be the Jacobi polynomial of degree fc, nor- 
malized in i2(rf7a/3), i-e. 

Let a(^) be as in ^3.11 with the additional condition: a(^) > c > for 3/4 < £, < 
7/4. Note that suppa C [1/2, 2]. We define as in 

A,.(x,y)=^a(fc/2^)n^-'^(x)n^'''(y). 

k 
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Let 7]^ = cosOj,^, V — 1,2, ... ,2^, be the zeros of the Jacobi polynomial 
ordered so that 771 > 772 > • • • > r\2i and hence < Qj^\ < 6j^2 < ■ ■ ■ < Oj 2J < tt. 
It is well known that (cf. (3^ ') 

0,,^ - 5- (33) 

We set 

A", ={r;, :i.= l,2,...,2J"}. 

Let Tin denote the space of all polynomials of degree less than n. As is well 
known the zeros of the Jacobi polynomial serve as knots of the Gaussian 
quadrature which is exact for all polynomials from n2j+i_i, that is, 

[ Pdjo.,p = hv.PM, VP e n2.+i_i, 

where the coefficients > are the Christoffel numbers [s^l and bj^^^ ~ 

2"'' wq,,^(2^ ; ?7i.) with 

tJ„,/5(2J';x) := (l-a; + 2-2j)"+i/2(i + 2. + 2-2j)/3+i/2_ 
We now define the Jacobi needlets by 



^3,vA^) = Vhv^A2j{x,7j^), 1,2,...,2^; j > 0, 

and we set ^0(2;) = ijj-i^ri{x) ~ 1, rj (z X-i with X^i consisting of only one 
point rj ~ 0. From Proposition [2l (ipj.ri^) is a tight frame of L2(d7ct/3), i.e. 

Il/ll2= E E K/'^.-.'z)!'' V/ e L2(d7o/3)- 

Hence 

IIV',.,Jl2 < 1- (34) 

Notice that cannot be an equality since otherwise the needlet system {ipj,ri„) 
would be an orthonormal basis and this is impossible since 

E Vhr^'^j.n^ '^Ybj^jj^L2j{x,i]^) = / L2i{x,y)d"f{x) = 0. 

We now recall the two main results from which will be essential steps in 
our development. 

Theorem 4. For any I > 1 there exists a constant C; > such that 

\^,,,Acos9)\<Q ^ aMA^^m -'-IV O<0<7r. (35) 

,/t^a,/3(2J,cos6') (,l + 2^|y- 2j|j' 
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Obviously 

w„,0(2-'';cos0) = (2sin2(0/2) + 2-2J)"+i/2(2cos2(0/2) + 2-2jy+i/2, (gg) 
Therefore, < 61 < 7r/2 =^ tj„,^;(2^ cos 6*) - {{2^ 9 + l)^°'+^2-^'^^°'+^'> and hence 

l^...(cos.)|<Q^^^:|^^ 0<e<n/2. (37) 

Similarly, from 

7r/2 < 6* < TT =^ cj„,^(2^cos6') - (2^ (7r - 61) + i)2/3+i2-j(2/3+i) 
and hence 

2i(i+/3) 1 
l^...(cos^)|<Q (^^^^.,^_^,^, (2.-(.-^) + l)/^^V2 ' -/2<^<- (38) 

Theorem 5. Let < p < oo. Then 

/ f \ i/p / 2-' \ i/2-i/p 

Using (1221) and we infer uja,fi{j;ri^) ^ 2--'(2"+i)ty2a+i if i < < 2^-1 
and Wa,/3(j; ??^) 2-^(2/3+1) (2J - + l)2/3+i if 2^-1 < 1/ < 2^. Consequently, 

l<z.<2^-i=^ ||^^.^_ 11^ < (^-^j^ j , (39) 

2^-1 <.< 2^-=^ ||^^.,J,^ < (^^-— -^^^j . (40) 
Corollary 1. Let 1 < p < oo anrf 1/g = 1. Then 

V(j, ??>.), ll'0J,»?Jlpll'0J,»?Jlg < CpCq 



9.2. Estimation of the Lp norms of the needlets 

Here we establish estimates ([5(7 | - ([2T|) for the norms of the Jacobi needlets. In 
fact we only need to prove the lower bounds because the upper bounds are given 
above, see Theorem [5] and (p9 | - p0)) . We record these bounds in the following 
theorem. We want to express our thanks to Yuan Xu for communicating to us 
another proof of this result. 

Theorem 6. V < p < oo, G N, 
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(1 + (2J- _ ^))/3+l/2 j < II ^J,r,J|p<Cp (^(i + (2J-i/))/3+l/2^ 

or equivalently 

IIV'.,.JIp-(-^— T . (41) 

A critical role in the proof of this theorem will play the following proposition. 

Proposition 5. Let be an arbitrary positive constant. Then there exists a 
constant c > such that 

2N-1 

[Pfc"^^(cos6i)]2 > coJa,f}{N;cos0)-^ for c^N-^ <e< tt-c^N-^, N>2. 

k=N 

(42) 

Proof. The proof will rely on the well known asymptotic representation of Jacobi 
polynomials (sf. [32, Theorem 8.21.12, p. 195]): For any constants c > and 
e > 

Bin0"(^cos0%-'3(cos^) 

^ nn + a + 1) / g X ^ gi/20(„-3/2) (43) 

nl \smo/ 

for cn~^ <0< TT — £, where N — n+(Q; + /9+l)/2 and Jq is the Bessel function. 
Further, using the well known asymptotic identity 

/ 2 \ 

•^"(^)=( — ) cos(z + 7) +0(2-3/2)^ z-^oo (7 = -a7r/2-7r/4), (44) 
one obtains (sf. [H, Theorem 8.21.13, p. 195]) 

/ 0\ -"-1/2 / ^\ -/3-1/2 

P^''3(cos 6) = (7rn)-i/2 ( sin - j ( 2 J {cos{Ne+-i)+{ne)-^0{l)} 

(45) 

for cn ^ < 9 < TT ^ cn ^. 

As is well known the Jacobi polynomials Pj^'^ and P^_^'^ have no common 
zeros and hence it sufhces to prove (jH]) only for sufhciently large N. Also, 
P^'^(— .t) = (— l)'^P^'"(x) and therefore it suffices to prove ([42]) only in the 
case c*A^-i < 6* < 7r/2. 

Denote by Fn{0) the left-hand side quantity in (|42|) . Then by (liSj) . applied 
with c = 1/2, it follows that 

2N-1 

E 

k=N 
2N~1 



Fn{0)> N~^9-^"-^ {ciCos^{ke + h{d))~C2{ke)- 

k=N 
2N~1 

>c'N-^0-^°'-^ Y cos^ {k9 + h{ej) ^ c"0-^°'-\Ne)-^, 



k=N 
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for N-'^ <9< 7r/2, where h{e) = (a + /3 + 1)9/2 - 7ra/2 - 7r/4. It is easy to 
verify that for nN-'^ <0 <tt/2 



2N-1 



k=N 

Therefore, 



^ cos\ke + h) = ^ + 1^ cos((37V ^l)e + 2h)>^-[\ 



N 
1 



2Ne 



> 



N 



(46) 



Fjv(6i) > 6i-2"-i(c74-c"(iV6')-2) > (c78)6i-2a-i 
> cUa,piN; 9) for c*^"^ < 6* < 7r/2, 

where c* = max{7r, (8c"/c')^/^} > 0. 

It remains to estabUsh ^ for c^iV^^ < 6* < c*iV-i. Denote S = (a+/3+l)/2 
We now apply (|43|) with c = c* and e = tt/2 to obtain using that r{n + a 
l)/n\ ^ n", sm9 ^ 9, and 



P^''^{C0S9)\ >0-2"(ci[J„((fc + 5)0)]2-C2fc-3/20l/'|Ja((fc + 5)0)|) 



> ci6 



-2a 



Mik + 6)9)] 



c9 



-2a 1 



Choose A so that 9 = and c* < A < c*. Summing up above we get 

2N-1 

Fn{9) > ci9"^" ["^"((^ + '^)^)]' - c9-^"N-^ 



k=N 
2N-1 



k=N 
N-1 



-c9-'^°'N-\ 



Obviously, the last sum above involves only values of the Bessel function Ja(9) 
for c* < < c*(2 + (5) and hence uniformly in A € [c^, c*] 



N-l 



5Am2 1 



0, TV 



The second sum above can be viewed as a Riemann sum of the integral 
Jq JaiK^ + ^))d9, which is a continuous function of A € [c*,c*] and hence 
min;^g[co,c*] Jq Ja{^{9 + l))d9 >c>0. Consequently, for sufficiently large N 

Fn(9) > 9-^"{cciN/2 - cN-^) > c9-^'^N 

> cuja^i3iN;9)for < 9 < c* . 

From this and (US]) it follows that (|^^ holds for sufficiently large N and this 
completes the proof of Proposition [5] □ 
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Proof of Theorem [61 We first note that (sf. jsl]) ll^^'^ix) ~ k^/^P^''^{x) and 
hence 

>cu;c,,p{V;r],) ^ a\k/V){P^'^ {cos 6 

f 2j<fe<|2J 

Observe also that there exists a constant > such that c*/2^ < < 
TT — , 1, 2, . . . , 2^ . We now employ Proposition [5] and ([34]) to conclude 
that 

< c < ||i/'j,,,J|2 < 1. (47) 

We need to establish only the lower bound in Theorem [6l Recall first the 
upper bound from Theorem [5] 

U J. nJp<Cp (———-) , 0<p<oo. (48) 

Suppose 2 < p < oo and let l/p+ 1/q = 1. By p7)) and Holder's inequality we 
have 



< C < ||V'j,,,J|2 < \\'^j,vJp\\^J,vJq < c|lV'i,r;Jlp(- 



2i \ l/2-l/g 



^Wa,/3(2J;?7^) 
which yields 

/ 2-' \i/2-i/p 
||^,,,J|p>c( ) . (49) 



The case p = cx) is similar. In the case < p < 2, we have using (|47)) 

2i X i-p/2 



.Wa,/3(2-?';r?,.)/ 

which implies (|49|) . The lower bound estimates in Theorem [6] follow by ([49]) . □ 

9.5. Bounding for the norm of a linear combination of needlets 

Our goal is to prove estimate (|27p . which we record in the following theorem: 

Theorem 7. Let Q < p < oo. There exists a constant Ap > such that for any 
collection of numbers {X^ : = 1, 2, . . . , 2^}, j > 0, 

2^ 2^ 
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and if p = oo, 

\\2^>'-^'^j,riJkoaifc.„) < ^ooSupIA^IIIV-j-^JIl^c^^^^). (51) 

v—1 

V 

Proof. Let us begin with the simplest case p — oo 

\\J2K^j.r,Mo.<SUp\K\U,.,J\^ 11°° 

y " y II rj,!),. lloO 

We can conclude using the following lemma: 
Lemma 1. 3C < oo such that 

Proof. Using Theorem HI and ([i^]) . we have 



liV-x.Jloo - V^o,/3(2^cos0) (1 + |2^-0 - ^i^iy 2^/2 
and hence 



l^j-,^JIoo" - e V V^a,/3(2^cos0) (1 + 12^-0 -^i^D' 

It remains to prove that this last quantity is bounded. 
But using ([36]) . one easily shows that (see [2l|): 



y/uJo,,p{2->,f]^) ^ ^CJ„,^(2J,C0S6>^) ^ ^ 1^^.^ _^ j^^|^l/2+aV/3 

^lJq,/3(2^cos6') ^tJa^/3(2J,cos6') 
consequently, 



V 



< 



^ V^„,;5(2^cos0) (1 + \2ie - 7:,,\y 

T ? (i + |2.-^-Hy-^/^-°--^ ^ " ^''^ 

for sufficiently large /. □ 
Let now < p < oo. Consider the maximal operator 

(A/,/)(x) = sup (i- / \f{u)\'duy^\ s > 0, 

where the supremum is taken over all intervals J C [—1,1] which contain x 
and |J| denotes the length of J. As elsewhere, let a A /3 > —1/2. It is well 



G. Kerkyacharian et al./NEED-D: estimation in inverse problems 



70 



known that the weight LUa.isix) = (1 — a;)"(l + x)'^ on [—1, 1] belongs to the 
Muckenhoupt class Ap with p > lifaV/3 < p — 1- Then in the weighted 
case the Fefferman-Stein maximal inequality (see [IJ] and [2]) can be stated as 
follows: If 1 < p, r < (X) and uJa,f3 G Ap, then for any sequence of functions (fk) 
on [-1,1] 



|(^(AfiA)' 



l/r 



Lp(7c.3) 



l/r 



I-p(7q,/3) 



Using that Mi|/|* — {MsfY one easily infers from above that the following 
maximal inequality holds: If < p,r < oo and < s < min{p, r, ^^^_^^ }, then 
for any sequence of functions (fk) on [—1, 1] 



|(^(M,/,)' 



l/r 



Lp(7Q,0) 



< c 



|(EIA- 



l/r 



Lp(7Q,/3) 



(53) 



As in ^9.1[ let ?7iy = cos6'j^^, ly — 1,2,..., 2-', be the zeros of the Jacobi 

TT, respectively. 



polynomial -P^'''. Set r/o — 1, ^i+i = —1 and 6j,o — 0, 



Denote = [^^^if^, and put 



Hu = hylj^ with /ij/ = ^ 



2^ 



1/2 



Wq,/3(2-';?7i.; 



where l/_^ is the indicator function of 7^. 
We next show that for any s > 

\^,,^Ax)\<c{MsH,){x), xe[-l,l], Vi. = l,2,...,2^ j>0. (54) 

Obviously, {Msli^){x) = l/„(a;) for a; E I^. Let x G [—1, l]\/,y and set cos0 ~ x, 
e e [0,7r]. Then 



msh^){x)Y 



Viy-l - Vi^+1 



\x-ri^\ \x-r]^\ 

sini(0j^y+i — 6'j^y_i) sin i(0j_^+i + 6'j^i,_i) 



2-H 



|0-0,-,|(0 + 0,,.)- 



Using that > c,2 for some constant c* > 0, one easily verifies the inequal- 
ity 

1 



> 



From above it follows that 

c 



(Afa/J(cos6') > 



(l + 2J|6'-0j-,|)2A 
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which along with ((35|) (applied with I > 2/s) yields ([U 
Combining ([5^ and ([55]) we get 



2^ 2^ 



II E ^'^^^^^x^,..,) ^ i^''i'ii^^iil(7.,^)- (55) 

1/=! i/=l 

Straightforward calculation show that || 1/,^ ||lp(7q 3) ~ ( 2 ■'wq_/5(2-' ; ?7i/) 1 and 
hence, using Theorem |6l 

/ 2-' \i/2-i/p 



This coupled with ^ implies □ 
Corollary 2. 1/Fe have, for 1 < p < 00, 

2^" 2^' 

\\T.(f'^^^M,vJkA'r..,) < ^p(EK/'^^-.'^^)rii^^-.'^^iiL(7=,.))'^' 



i/=i 



< A'^WfKh..,) (56) 



Proof. We have only to prove the righthand side inequality. 
Let us first consider the case p = 1. 



2^ 2^ 



'^\{f^i^j,n.)\Uj,vJu{'y^,^} <E / l/l(^)IV'i,»)„(a;)MAi(a;)||V'j,,,J|Li(7„,,3) 



2^ 

/ i/i(^){E in'^^y w .,.jiooii^,-.,jii}w < cciCooii/iii 



llV-J-.r/Jloo 

using lemma [T] and corollary [TJ 
For p = 00 , we have 

sup |(/,V'j>,J|||V'j,77JIl^(7=./3) 
l<i/<2i 

< sup / |/|(a:)|V'i,r,,(a;)|d/i(a;)||V'j,,,J|L„„(^„^) 

1<1/<2J J 

< 11/11 

sup liV'j.ifJIlllV'j ,?7[y II 00 — 00 
l<iy<23 

and again we have used corollary [TJ 

Let now 1 < p < 00 Using Holder's inequality + 1/q = 1) we get 
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Hence 



2' 



2^ 



as by (123) and (gD]) we have 

IIV'„.J|ocllV',„J|?/^||V',„J|^ < c^cf/'^cp 

we have concluded using lemma [TJ 

□ 

Corollary 3. let 

< C;||A,_i/ + A,/ + A,+i/||l,(^„,,) (57) 

(by convention A_i(/) = 0) 

This claim is a simple consequence of the previous corollary, as 

yrjnu e Xj, (/, Vj,„J = (Aj-i/ + Aj/ + Aj+i/, 

9.4- Besov Space 

For / e ILp(7Q_^) let us define: 

VneN, EM,P) ^ ;gj\f ~ P\\p 

Clearly 

||/||p>i?o(/,p)>i?i(/,p).... 
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Definition 2. Besov space B^^^. 

Let l<p<oo, 0<(7<oo, 0<s<oo. The space -B* ^ is defined as the 
set of all the functions f Ghp such that: 

OO -J 

WfWBi , - WfWp + (5^Ki?„(/,p))'-)^/« < OO, if q<oo, 

n=l ^ 

{resp. II/IIbj^ = \\f\\p + sup n''En{f,p) < oo) 

n>l 

As n ^ En{f,p) is not increasing, we have an equivalent norm ||/||_b« ^ : 

OO 

ii/iis»„~ii/iip+(E(2'''^2.(/,P)n'/', if «<oo, 

3=0 

{resp. \\f\\Bs^ = \\f\\j, + snp2^^E,j{f,p)) 

j>0 

Theorem 8. Let f e hp{-fa^p) and 

2^ 

L/=l 

then 
1. 

OO 

~ ll/llp+ (E(2'''ll^^-(/)ll^')'')'^' (58) 

0=0 

with the usual modification for q = oo. 

2. 

OO V 

(59) 

with the usual modification for q = oo. 

OO 

with the previous modification for q = oo. 
Proof. If Q G 1123-1 , j > 1, we have 

\\^j{mp = \\Mf-Q)\\p<cAf-Q\\p 

and hence 

\\Aj{f)\\p<E^,-.{f,p). 
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On the other hand 

oo 

Therefore, if 

||A„||p < e„2-'"^ 

we have 

oo oo 
ni—j + l m—j+1 

with 5 € ^g(N), by a classical convolution result. Thus ([55)) is established. 
Now, by ([57)1 we have 

iiA,(/)ii, < c,(f]i(/,^,,,jni^,-,ji£^(^^^^))Vp 
i/=i 

< C;(||A,_i/||p + ||A,/||p + ||A,+i/||p). 

This combined with readily implies and ^Q. □ 
Remark 1. Suppose Xj.ri^ is a family of numbers such that 

oo 2^ 
j=0 v=\ 

(with the usual modifications for p = oo, q ^ oo) 
and let 

j=0 v=l 

(which is, by Theorem^ obviously defined in L^j f € ^ even though not 
necessarily 

^j ri^ — {fi i'j,rj^)- 

This is due to Theorem^ and since 
where 
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